Generalized Linear Models

Basics of Generalized Linear Models (GLMs)

• GLMs are a flexible generalization of ordinary linear regression that allows for response variables that have error distribution models other than a normal distribution.
• Components of GLMs:
  • Random Component: Specifies the distribution of the response variable (e.g., Normal, Binomial, Poisson).
  • Systematic Component: A linear predictor, a combination of explanatory variables (predictors).
  • Link Function: Connects the mean of the response variable to the linear predictor (e.g., identity, log, logit).

Common link functions and GLMS

• Identity Link: Used for normally distributed data (linear regression).
• Logit Link: Used for binary outcome data (logistic regression).
• Log Link: Used for count data (Poisson regression).

Over-Dispersed Data

• Over-dispersion in general refers to having variance greater than that assumed for the theoretical data model.
  
• Over-dispersion can also refer to having a variance that is greater than the mean
  • Similarly equi-dispersion would refer to having variance equal to the mean.

Common applicataions

Causes

Candidate Distributions

1. Negative-Binomial
2. Generalized Poisson
3. Double Poisson
4. Conway-Maxwell-Poisson (CMP)

• Zero inflated disitributions
  • ZIP
  • ZINB
  • ZIDP/ZIGP

Negative-Binomial

• Parameters: mean: \(\mu\), dispersion: \(k\)¹
• Variance: \(\mu + \mu^2/k\)
  • Function of mean and dispersion parameter
  • Clearly captures over-dispersion.

Generalized Poisson

• Parameters: \(\lambda\), \(\theta\)
• Mean: \(\lambda / (1- \theta)\)
• Variance: \(\lambda / (1- \theta)^3\)

\[ f(Y = y) = \frac{\lambda(\lambda + \theta y)^{y-1} e^{-(\lambda + \theta y)}}{y!}, \quad \lambda > 0,\space \theta \in \mathbb{R} \]

• Designed to extend to overdispersed and underdispersed count data

Double Poisson

• Parameters: \(\mu\), \(\theta\)
• variance: \(\mu / \theta\)
• Extension of the double exponential family (Efron 1986) defined by pmf \[ f(Y = y) = (\theta^{1/2}e^{-\theta\mu}) \left(\frac{e^{y}y^y}{y!}\right) \left(\frac{e \mu}{y}\right)^{\theta y} \]

Conway-Maxwell Poisson (CMP)

• Parameters: \(\lambda\), \(\nu\)
• Weighted Poison distribution with pmf: \[ f(Y = y) = \frac{\lambda^y}{(y!)^\nu Z(\lambda, \nu)}, \quad Z(\lambda, \nu) = \sum_{y=0}^\infty \frac{\lambda^y}{(y!)^\nu} \]
• Includes spacial cases (Sellers et al. 2012) of Poison\((\lambda)\) when \(\nu = 1\), geometric\((\lambda)\)

Results

• It has been found and shown that modeling over-dispersed data with impropper distributions leads to biased results.
• To prevent biased results from over dispersed data, using models such as the CMP, GP, or DP model can prove beneficial
• Overall the CMP is found to have the most flexibility modeling of over- and under-dispersion due to the GP model truncating for some dispersion parameters